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We analyze the performance of Low-Density-Parity-Check codes in the error-floor do- 
main where the Signal-to-Noise-Ratio, s, is large, 5 ^> 1. We describe how the instanton 
method of theoretical physics, recently adapted to coding theory, solves the problem of char- 
acterizing the error-floor domain in the Laplacian channel. An example of the (155,64,20) 
LDPC code with four iterations (each iteration consisting of two semi-steps: from bits-to- 
Q I checks and from checks-to-bits) of the min-sum decoding is discussed. A generalized com- 

O I putational tree analysis is devised to explain the rational structure of the leading instantons. 

The asymptotic for the symbol Bit-Error-Rate in the error-floor domain is comprised of indi- 
O ' vidual instanton contributions, each estimated as ~ exp(— /inst;L • where the effective dis- 

O . tances, /inst;L> of the the leading instantons are 7.6, 8.0 and 8.0 respectively. (The Hamming 

! distance of the code is 20.) The analysis shows that the instantons are distinctly different 

from the ones found for the same coding/decoding scheme performing over the Gaussian 
channel. We validate instanton results against direct simulations and offer an explanation 
^ for remarkable performance of the instanton approximation not only in the extremal, s ^oo, 

O ■ limit but also at the moderate s values of practical interest. 
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A novel excitingera has begun in coding theory with the discovery of Low-Density-Parity- 
Check (LDPC) JUlS] and turbo [3] codes. These codes are special, not only because they can 
2 I approach the virtually error-free transmission limit, but mainly because a computationally effi- 

■ cient iterative decoding scheme is readily available. When operating at moderate noise values 

O . these approximate decoding algorithms show an unprecedented ability to correct errors, a re- 

^ I markable feature that has attracted a lot of attention 0, Bl 0]. However, it was also shown 

I that the approximate algorithms are incapable of matching the performance of Maximum- 

O ■ Likelihood (ML) decoding beyond the so-called error-floor threshold found at higher Signal-to- 

Noise-Ratios (SNR). The importance of error-floor, i.e. highest SNR, analysis was recognized 
I in the early stages of the turbo code revolution [7], and it soon became apparent that LDPC 

^ I codes are also not immune to the error-floor deficiency |Q, [sl]. To estimate the error- floor 

asymptotics in modern high-quality systems is a notoriously difficult task because direct nu- 
merical methods, e.g. Monte Carlo, cannot be used to determine Bit-Error-Rate (BER) below 
10^. The main approaches to the error-floor analysis problem proposed to date include: (i) 
a heuristic approach of the importance sampling type [4], utilizing theoretical considerations 
developed for a typical randomly constructed LDPC code performing over the binary-erasure 
channel and (ii) deriving lower bounds for BER [10]. 

Recently, we (in collaboration with V. Chemyak and B. Vasic) have also proposed a physics 
inspired approach that is capable of a computationally tractable analysis of the error floor phe- 
nomenon [11]. An efficient numerical scheme was proposed, which was ab-initio by construc- 
tion, i.e. the optimization scheme required no additional assumptions (e.g. no sampling). This 
numerical optimization scheme, called the instanton-amoeba scheme, which plays a central 
role in our analysis, was shown to be accurate at producing configurations whose validity, for 
actual optimal noise configurations, can be verified theoretically. Finally, the instanton-amoeba 
scheme, introduced in [12], is also generic, in that there are no restrictions related to the type 
of decoding or the channel. 



To illustrate the last, most important point, we complement the analysis of lllin that focused 
on the white Gaussian symmetric channel, by using the new results for the white Laplacian 
channel explained in this manuscript. Our choice of the Laplacian channel is arbitrary, e.g. in- 
fluenced by its relevance to the description of fiber-optics communication channels. (Amplifier 
noise, known to have Gaussian statistics, contributes additively to the electric signal carrying 
the information. However, the intensity, the electric field squared, is detected on the receiver 
end. Therefore, the resulting transition probability, characterizing the noise in the fiber optics 
channel as the whole, shows exponential tails. See LlSil for a discussion of these and other 
statistical errors in fiber optics channels.) 

Our goal is to demonstrate using the example of the Laplacian channel that 

• The numerical optimization approach to finding the most damaging configuration of the 
noise, instanton-amoeba, is computationally efficient. 

• Subsequent theoretical analysis of the iterative decoding instanton based on the notion 
of the computational tree is channel specific, but it is also generalizable, i.e. the theo- 
retical scheme can be modified to explain the rational structure of instantons for any, in 
particular Laplacian, channel. 

• Instanton configurations for different channels are different. Thus, information on the 
error-floor analysis available for a channel (say, for the Gaussian channel) does not al- 
low quantitative description of the error-floor in another channel (say, in the Laplacian 
channel). 

This manuscript is organized as follows. We describe the problem of error-floor analysis, 
introduce the Laplacian channel and briefly review the results of I I 1.1 in Section HI Our theo- 
retical analysis, generalizing the computational tree approach of BSD, is detailed in Section im 
Section IHTI explains results of numerical instanton-amoeba evaluation. Here we present the 
three most important (for ^ 1) instantons, for example of the min-sum decoding with four 
iterations performing over the (155, 64, 20) LDPC code described in 1 14]. We also discuss here 
how the numerically found instanton is rationalized/explained theoretically. The comparison 
of Monte Carlo simulations and instanton prediction is discussed in Section |IV| Some final 
remarks and comments are presented in Section |Vl concluding the manuscript. 



1. SETTING THE PROBLEM 

Let us begin by introducing notation. A message word consisting of K bits is encoded in an 
N-hii long codeword, N > K. In the case of binary, linear coding a convenient representation 
of the code is given hy M > N — K constraints, often called parity checks or simply checks. 
Formally, a = (oi , . . . , Oat) with O/ = ± 1 , is one of the 2^ codewords if and only if Yliea = 1 
for all checks a = 1, . . . ,M, where / G a if the bit / contributes the check a. The relation 
between bits and checks (we use i E a and a 9 i interchangeably) is often described in terms 
of the M X N parity-check matrix H consisting of ones and zeros: Hai = 1 if / G a and Hai = 
otherwise. A bipartite graph representation of H, with bits marked as circles, checks marked 
as squares, and edges corresponding to the respective nonzero elements of H, is called the 
Tanner graph of the code. For an LDPC code H is sparse, i.e. most of the entries are zeros. 
Transmitted through a noisy channel, a codeword gets corrupted due to the channel noise, 
so that the channel output is jc 7^ a. Even though information about the original codeword 
is lost at the receiver, one still possesses the full probabilistic information about the channel, 
i.e. the conditional probability, P{x\&), for a codeword a' to be a pre-image for the output 
word X, is known. In the case of independent noise samples, the full conditional probability 



can be decomposed into the product, P{x\&) = YliPi^il'^'i)- A convenient characteristic of the 
channel output at a bit is the so-called log-likelihood, hi = log[p(x,| + l)/p{xi\ — l)]/2. The 
decoding goal is to infer the original message from the received output, x. ML decoding (which 
generally requires an exponentially large number, 2^, of steps) corresponds to finding the most 
probable transmitted codeword given x. Belief Propagation (BP) decoding Q] constitutes 
a fast (linear in ^,A^) yet generally approximate alternative to ML. As shown in HI] the set 
of equations describing BP becomes exactly equivalent to the so-called symbol Maximum- A- 
Posteriori (MAP) decoding in the loop-free approximation (a similar construction in physics is 
known as the Bethe-tree approximation [ 16]), while in the low-noise limit, i.e. in the limit of 
very large SNR, s ^ ML and MAP become indistinguishable and the BP algorithm reduces 
to the min-sum algorithm: 

(n) 

where the message field r]-^^ is defined on the edge that connects bit / and check a at the 

n-th step of the iterative procedure and T|-^^ = 0. The result of decoding is determined by a- 

posteriori log-likelihood, m^"\ defined by the right-hand- side of Eq. ^ with the restriction 
P 7^ a dropped. The BER measuring probability of errors at a given bit / becomes 

Bi = J dxB{-mi{x})P{x\l), (2) 

where 0(z) = 1 if z > and 0(z) = otherwise; a = 1 is assumed for the input (since in a 
symmetric channel the BER is invariant with respect to the choice of the input codeword). 
When the BER is small (SNR is large) the integral over output configurations x in Eq. Q is 
approximated by: 

5,~£yinstXi'(jCinst|l), (3) 
inst 

where JCjnst are the special instanton configurations of the output maximizing P{x\l) under the 
error-surface condition, m,{jc} — 0; Vmst combines combinatorial and phase-volume factors 
(the latter one accounts for what physicists call fluctuations around the respective instanton). 
Individual instanton contributions into the rhs of Eq. ^ decrease significantly with increasing 
SNR. Thus at large SNR only instanton(s) with the highest P(jCinst| 1) is (are) relevant. 
For the common model of the Additive White Gaussian Noise (AWGN) channel, 

PG(^|a) =exp(-/(x-o)V2)/y'W^, (4) 

finding the instanton, ^^^^^ = 1 — JCinst = l{u)u, turns into minimizing the length /(«) with re- 
spect to the unit vector in the noise space u, where l{u) measures the distance from the zero- 
noise point to the point on the error surface corresponding to u. This task of the instanton 
analysis for the AWGN channel was discussed in detail in [1 1]. In [1 1] we developed a numer- 
ical scheme where the value of the length l{u) for any given unit vector u was found by the 
bisection method. The minimum of l{u) was found by a downhill simplex method also called 
"amoeba" lfl3ll . with accurately tailored (for better convergence) annealing. (Note, that even 
previously, the numerical instanton method was successfully verified in [ 12] against analytical 
results in the loop-free case.) To demonstrate the utility of this method we chose in [11] the 
example of the (155, 64, 20) LDPC code of iQ. (The parity check matrix of the code is shown 



in Fig. SI of [TT] .) The code includes 155 bits and 93 checks. Each bit is connected to three 
checks while any check is connected to five bits. The minimal Hamming distance of the code 
is /^L G ~ -^0' ^ 1, and if the decoding is ML, BER becomes ~ exp(— 20 ■ jl) in 

the Gaussian channel. Iterative decoding is suboptimal, thus respective error-floor asymptotics 
become /'(jcinstl 1) ~ ^^P(~^kist G ' ■^^/•^)- "^^^ numerical, and subsequent theoretical, analyses 
of |TT] suggest that the instantons, as well as the respective effective distance, /inst;G» do depend 
on the number of iterations. Focusing primarily on the already nontrivial case of four iterations, 
we showed in ifllll that the three minimal weight (largest probability) instantons have effective 
lengths, = 46^/210 ^ 10.076, /J^ = 806/79 ^ 10.203 and /Jq = 44Vl88 ^ 10.298 re- 
spectively. These instantons were found as the result of multiple attempts at instanton-amoeba 
minimization. The remarkable integer/rational structure of the instantons found numerically by 
instanton-amoeba for the AWGN channel admits a clear theoretical explanation discussed in 
details in ||Tlt]. We have already suggested in ifTlll that the instanton analysis (in both numerical 
and theoretical parts) is actually generic, and is thus applicable to wide range of different codes 
and channels. 

To illustrate this last point we focus in this manuscript on analysis of the generalized Addi- 
tive White Laplacian Noise (AWLN) channel: 



PGLap(-^lo) °^ exp (x-0)2 + a2^ 



(5) 



where s is the signal-to-noise-ratio (SNR) and a is the regularization parameter. (We are mainly 
interested in the a ^ 0, thus a is introduced primarily for the purpose of accurately regular- 
izing/resolving the singularity at ^ = x — o = 0.) If the detected signal at a bit is 1 — ^, the 
respective log-likelihood at the bit is defined as 



/z= — In 
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v/(2-^)2 + a2 



^2 + a2 



-1, ^>2; 
1-^, 2>^>0; 
+ 1, 0>^. 



(6) 



where one chooses to measure log-likelihoods in the AWLN channel in units of SNR, s (and 
not in units of the SNR squared that was natural choice in the AWGN channel). 

In the Laplacian channel (a = 0), finding the instanton means to minimize /(«) Y.i Wi\ with 
respect to the unit vector u in the A'^-dimensional space, rather then minimizing l{u) that was 
the case for the Gaussian channel. Notice, that just from this fact one finds absolutely no reason 
to expect that instantons for Gaussian and Laplacian channels are in any way related to each 
other. The contribution of an instanton to the BER for ^ 1 , characterized by the effective 
distance /inst;Lj is estimated as ~ exp(— /inst;L ■ s) in the case of the Laplacian channel. 



II. GENERALIZED COMPUTATIONAL TREE ANALYSIS IN THE LAPLACIAN 

CHANNEL 

In this Section we describe a theoretical approach to the instanton analysis. This analysis, 
based on the computational tree construction of Wiberg ||5i:], was discussed in llllh for the 
Gaussian channel. Here we explain how the analysis can be modified to describe instantons in 
the case of the AWLN channel. 

We start with the universal, i.e. channel insensitive, part of the construction. The compu- 
tational tree is built by unwrapping the Tanner graph of a given code into a tree from a bit for 
which we would like to determine the probability of error. (This bit will be called erroneous 
bit.) The number of generations in the tree is equal to the number of min-sum iterations. As 
observed in [5^, the result of decoding at the erroneous bit of the original code is exactly equal 



to the decoding result in the tree center. It should be noted that once log-likelihoods represent- 
ing an instanton are distributed on the tree, one can verify directly (by propagating messages 
from the leaves to the tree center) that the algorithm produces zero a-posteriori log-likelihood 
at the tree center. Any check node processes messages coming from the tree periphery in the 
following way: (i) the message with the smallest absolute value (one assumes no degeneracy) 
is passed, (ii) the source bit of the smallest message is "colored", and (iii) the sign of the prod- 
uct of inputs is assigned to the outcome. At any bit that lies on the colored leaves-to-center 
path the incoming messages are summed up. The initial messages at any bit of the tree are 
log-likelihoods and, therefore, the result obtained in the tree center is a linear combination of 
the log-likelihoods with integer coefficients. The integer corresponding to bit i of the origi- 
nal graph is the sum of the signatures over all colored replicas of / on the computational tree. 
Therefore the condition at the tree center becomes = 0. 

So far the discussion has been generic. Let us now adapt this generic construction to the case 
of the generalized AWLN channel described by Eq. Returning from the computational tree 
to the original graph and maximizing the integrand of Eq. © with the condition, Y.i'^M = 0, 
enforced we arrive at the following expressions for the effective length: 



/inst;L = £Y^- +a2+X£R,/Zi, (7) 

where X is the Lagrange multiplier enforcing the zero a-posteriori log-likelihood condition at 
the tree center. Minimizing Eq. Q with respect to ^/ one derives 




^2 + a2 2-Xm- ^ ^ 

Expressing ^, in terms of n, and X involves solving a cubic equation. Note also that, first, the 
left-hand-side of Eq. (EJ) is monotone with respect to ^/ in the interval of < ^/ < 2, and, second, 
the expression becomes 1 as a 0. Consider the domain of 2 > > and a <^ (2 — ^,) . Then 
Eq. (HI) becomes 

^ hi^l-- — ^1 ■ (9) 



One observes that either of the two possibilities is realized at a ^ 0: (1) Xrii 1 and — *• 
const 7^ 0; or (2) Xn, — > const ^ 1 then 0. One should also add to these two possible cases 
a third one (that is obviously not explained by Eq. Q) where ^ lies exactly on the border of the 
monotone interval, i.e. at ^ = 2 and h = — I. 

One finds that structurally an instanton consists of three types of colored bits corresponding 
to^ = 0, 0<^<2 and ^ = 2 respectively. One also finds that for all the colored bits with 
< ^ < 2 all the respective approach the same limit, n,- ^ even though respective 

may be distinct. This results in the following form of the zero a-posteriori log-likelihood 
condition at the tree center 

Y^Hih, = Nc - £ - 2N2 = 0, Zinst;L = 2m2 + £ 1^,1 = ^^~^^^ +2m2, (10) 

i /eset ;eset ^* 

where "set" is the set of colored bits on the original graph with < < 2; Nc is the total 
number of the colored bits on the computational tree; N2 is the number of marginal, ^ = 2, bits 
on the computational tree; is the number of replicas found on the computational tree for a 
bit i that belongs to the set (this is the same number for all i E set); m2 is the number of distinct 
marginal (i.e. ^ = 2) bits on the original graph. 



Eq. (fTOb represents the major theoretical result of our analysis. It explains the rational 
origin of the effective length and shows how the effective length depends on the set of integers, 
N^,N2^n^ and nii carrying the coding/decoding specific information. Notice also a remarkable 
common feature of the instantons. There is actually a strong degeneracy here if the number 
of colored bits with < ^ < 2 is two or larger: the effective length depends only on L,(=set^i' 
while otherwise, and modulo the requirement < ^, < 2, the ^, fields can be chosen arbitrarily. 
Therefore, to estimate the BER corresponding to the given set of integers, Nc,N2,n^,m2, thus 
explaining a continuous family of instantons rather then an individual instanton, one should 
also account for the degree of degeneracy (volume of the respective part of the phase space), 
B ~ V{Nc-,N2-,n^,m2) x exp[— * ■ /inst;L]- Our estimate shows that the V(A'c,A^2,«*,W2) -terms 
give sub-leading (i.e. non-exponential in s) corrections to the major (effective length) factors. 



III. INSTANTON-AMOEBA CALCULATIONS IN LAPLACIAN CHANNEL 

So far we have not discussed how to find the discrete values Nc,N2,n^ and m2 that are 
obviously dependent on the explicit structure of the LDPC code considered. To solve this 



problem we adopt the instanton-amoeba approach of llllll . 

We consider the (155,64,20) LDPC code of (\^ as an example. The minimal Hamming 
distance of the code is /inst;L = 20, i.e. for 5^1, and if the decoding is ML, the BER becomes 
~ exp(— 20 ■ s) in the case of the Laplacian channel. The BER is higher, ~ exp(— Zinst;L ■ s) 
with /inst;L < 20, if One decodes iteratively. For the min-sum decoding with 4 iterations we 
found that three minimal length instantons are characterized by Za;L = V.6, /b;L = 8 and /c;l = 8 
respectively. These instantons were disclosed as the result of multiple attempts at instanton- 
amoeba numerical minimization described above. 

The colored parts of the Tanner graph of the code and the respective parts of the computa- 
tional tree for the three configurations are shown in Fig. 1: the three panels (a,b,c) correspond 
to the three instantons showing minimal effective lengths. Each panel consists of two diagrams 
showing the relevant (colored) part of the Tanner graph and respective (four iterations deep) 
part of the computational tree. Bits/circles are shown with numbers correspondent to the or- 
dering of the bits explained in ifllll . The shadow bit is the erroneous one, i.e. it is the bit whose 
a-posteriori log-likelihood is exactly zero on the 4 step of the min-sum decoding. According to 
our theoretical analysis detailed above (that is also confirmed numerically in detail) there are 
three types of colored bits/cirlces with ^ = 0, 0<^<2 and ^ = 2, shown in Fig. 1 in white, 
green and red respectively. The white bits on the computational tree that are not numbered (and 
respective bits of the Tanner graph simply not shown in the Figure) can be chosen arbitrarily 
with the only requirement that they are distinct from any bits shown numbered in the Figure. 

Configuration (a) shown in Fig. la consists of 2 green bits with < ^ < 2 (numbers 79 
and 89) each appearing 5 times on the computational tree, and 2 red bits with ^ = 2 (numbers 
24 and 151) each appearing 7 times on the computational tree. The remaining 151 bits carry 
^ = noise. Therefore, the respective integers corresponding to this instanton are Nc = 46, 
A^2 = 2 ■ 7 = 14, = 5, m2 = 2, thus resulting according to Eq. (fTOI) in Za;L = 7.6. This effective 
distance was found with numerical precision by the instanton-amoeba method. The degeneracy 
in this family of instantons is one parametric: + = — 8/5 and — 1 </j3,/ji6< 1- Here, the 
erroneous bit, i.e. the bit with zero a-posteriori log-likelihood (marked striped in the Fig. la) 
is the white one. 

Configuration (b) consists of three green bits, with < ^ < 2, appearing four times each on 
the computational tree, and three red bits, with ^ = 2, appearing 7,6 and 6 times respectively. 
For this instanton one finds, N2 = ^9,n^= 4, and m2 = 3 {Nc is always 46 for the four iterations 
decoder) so that Zb;L = (46 — 2-19)/4 + 2-3 = 8. The erroneous bit (number 139) is white. One 
bit, numbered 1 12, is special here. Even though this bit has many replicas on the computational 



FIG. 1 : Visualization of three instantons with shortest effective lengths found by the instanton-amoeba 
scheme. Only relevant parts of the Tanner graph for the (155,64,20) code and respective computational 
tree with four iterations are shown. Numbers marking the bits are introduced in accordance with the 
convention described in jllll . The color coding used for bits is white for ^ = 0, green for < ^ < 2 and 
red for ^ = 2. See detailed explanations in the text. 

tree, thus potentially, it would be advantageous to have it green carrying the non-zero value of 
the noise, self-consistency strictly requires that ^112 = 0. There are at least two reasons for this. 
First of all, if bit 112 turns green making ^112 7^ one of its replicas on the computational tree 
(the one marked pale and adjusted to the red check/square in Fig. lb) screens bit 30 (positioned 
next to the red check) in the sense that this screened bit will not contribute to n^o. Consequently, 
^30 becomes 6 and not 7, thus making A'^2 smaller and /inst;L larger. Second, if ^112 7^ then 
one of the 5 replicas of the bit 112 contributes a-posteriori log-likelihood at the tree center 




SNR, s 

FIG. 2: Frame-Error-Rate vs Signal-to-Noise ratio, s, for the (155,64,20) code with four iterations of 
the min-sum decoding over the Laplacian channel. Solid and dashed lines show slopes (defined upto 
a constant shift in the log-lin plot) correspondent to the instanton with the shortest effective distance, 
/a;L = 7.6, and to the ideal ML decoding with the Hamming distance, /ml;L = 20, respectively. Filled 
and empty circles show results of direct Monte-Carlo simulations for 4 and 1024 iterations respectively. 

with "— " sign and nm becomes equal to 3, rather than 5. This number is smaller than = 4 
thus leading to the undesired effective length increase. Finally, the resulting degeneracy in the 
instanton family is two-parametric (corresponding to appearance of three, and not four, green 

bits): hi2 + hgg + hgg = 1 and —1 < hi2,hgg,hgg < 1. 

Configuration (c) has the same effective length as configuration (b), /c;L = 8, even though 
it is very different structurally. The (c) instanton has no green bits, thus it is non-degenerate 
and only one special configuration of hj fields is realized. There are four red bits, 56, 139, 141 
and 149, appearing on the computational tree 6,7,4 and 6 times respectively. The erroneous 
bit, 139, is red. The integers are m2 = 4, A^2 = 23 and Nc — 2N2 = 0, thus according to Eq. dlOb 
/c;L = 2m2 = 8. ^ 

In [11] we have argued, following the logic of [5], that each instanton is equidistant from 
some number of pseudo-codewords, i.e. codewords on the respective computational tree. This 
observation is obviously generic and thus it is applicable as well to the case of the Laplacian 
channel considered in the manuscript. For any of the instantons discussed above and illustrated 
in Fig. 1 there exists a respective pair of pseudo-codewords. (As argued in |0] an instanton 
may be degenerate — corresponding to a triple or in principle to even larger set of pseudo- 
codewords. This degeneracy, that was found present in the AWGN channel, was not observed 
here for the AWLN channel.) The first pseudo-codeword in a pair is just the all +1 codeword 
(-1-1 sits at every bit). The second pseudo-codeword in a pair can be introduced according 
to the following rule: put —1 at any colored (i.e. white, green or red) bit and -|-1 at any 
uncolored (thus not shown in Fig. 1) bits. Obviously this choice of the pseudo-codewords 
pairs is unambiguous. Indeed the white bits that are not numbered can be chosen arbitrarily 
(within appropriate bounds described above). Moreover, the ambiguity in choosing the second 
pseudo-codeword (containing —1 bits) is even stronger. Indeed, this second pseudo-codeword 
can consists only of two —1 bits (all other bits will carry +1): one —1 should be positioned at 



any red bit (with ^ = 2) from the last generation of the computational tree and another — 1 is 
placed on any uncolored bit sharing a check with the red bit. This special form of degeneracy 
is due to the fact that log-likelihoods assigned to any red bit and to an uncolored bit adjusted 
to the red one are the same in absolute value but opposite in sign. 

IV. VALIDITY OF INSTANTON APPROXIMATION AT MODERATE SNR 

The analysis of the previous Section suggests that the leading s oo asymptotic for BER 
(and for the Frame-Error-Rate as well) is governed by the instanton with the lowest effective 
length found, i.e. B ~ exp[— 5 ■ l^-i]- We have checked this prediction against direct Monte- 
Carlo (MC) simulations and found very good agreement already in the range accessible for the 
MC, B ^ 10^^. See Fig. 2. We observed that the actual behavior of BER is well described 
by the instanton not only in the asymptotic regime of highest SNR but also in the regime of 
moderate SNR where there is no a-priori reason to expect the instanton approximation to work 
so well. Our further discussion is to eliminate this point suggesting a plausible explanation for 
this surprising generality of the instanton asymptotic. 

Let us first clarify why the validity of the instanton asymptotic at the moderate values of 
SNR shown in Fig. 2 is surprising. Indeed, according to Eq. ^ the average value of the noise 
configuration length, / = unconstrained by the requirement to have zero a-posteriori 

log-likelihood at a bit, is (/) ~ N/s. This means that even at = 5 (the largest SNR shown 
in Fig. 2), where the error probability is already small, FER ~ 10^^^, the typical length of 
noise realization is still essentially larger then the respective instanton prediction: / ~ 155/5 = 
31 > /a;L = 7.6. Therefore, naively one expects the instanton to work well at 5 ^ 20, where 
(0 ~ ^a;L, while according to the MC results shown in Fig. 2 the instanton asymptotic sets 
already at s ^ 2.5, where FER ~ 10^^. (Notice, that the situation for the Gaussian channel is 
similar, see Fig. S2 of llill]. There the typical l^J^i^j is ~ N/s^, resulting in < >^ 30, while 
the respective instanton value is ^ 10.076.) 

Our approach to explaining the validity of the instanton asymptotic already at the moderate 
NSR is of the reverse engineering type: we first formalize what the Monte-Carlo results suggest 
and then present a plausible explanation for this phenomenon. 

One useful object is the probability distribution function of the channel noise length (fully 
unconstrained), that gets the following forms for the Gaussian and Laplacian channels respec- 
tively: 'Pl{1) = s^l^-^[T{N)]-^exp{-l-s) and ^Pg{1) = s^l^-^2^-^/^[r{N /2)]-^ exp{-l^ ■ 
s^/2). Typical noise configuration forms a "spherical" layer with "radius" I = |^,| ^ N/s in 
the A'^-dimensional noise space (or — L,^? ~ N/s'^ for the Gaussian channel). The "spher- 
ical" layer becomes thinner as A'^ grows. Obviously (p{l) does depend on the channel but it 
does not depend on the decoding scheme. Another useful object, that is decoding sensitive, is 
the (cumulative) distribution function Jes(0 of the length for the points positioned exactly at 
the error- surface. Estimation for FER is related to the area of spherical layer that lies outside 
of the error surface: FER = / JZ!P(Z) Jes(0- Strictly speaking this relation is exact for the 
Gaussian channel, but it is only qualitatively right (up to a 0(1) coefficient accounting accu- 
rately for the phase factor) in the Laplacian channel case. The integral FER = / JZfp(Z)iFEs(0 
can be viewed as the Laplace transform. Deducing from the Monte Carlo simulations that 
the instanton asymptotic is valid, FER <x exp(— Zinst;L ■ s) (or FER oc exp(— Zj^^^.q • for the 
Gaussian channel) one derives by the inverse Laplace transform Jes(0 = (1 ~ (or 
^Es(Z) = (1 - /Lt;G/^^)^^^"^ for *e Gaussian channel). 

We suggest that the special dependence of Jes on Z, deduced from the MC simulations, 
corresponds to an (A^ — 1) -dimensional area of the part of error-surface with lengths Z or less, 
9^ES ~ 5^^^^ where 5 is the respective line element. Given that the instanton configuration is 



extremal one assumes that, I — Zinst °^ 5^, that results exactly in the right expression for irEs(0 
in the Gaussian channel. We ought to assume that in the Laplacian channel case expansion of I 
with respect to 5 ^ / about / ~ Zinst, is of another type, I — oc 5, thus confirming the iFEs(0 
dependence on / observed in the Laplacian channel simulations. 



V. CONCLUSIONS 

The set of tasks formulated in the introductory Section was accomplished in Sections ^ 
Unl We have shown for the example of the Laplacian channel that the instanton-amoeba op- 
timization scheme, introduced in [12] and tested in [llj for the Gaussian channel, is compu- 
tationally efficient. We extended the theoretical analysis of Hllh . based on the computational 
tree approach of ||5|], explaining the rational structure of instantons in the Laplacian channel. 
The instantons are shown to be different for different channels considered with the same cod- 
ing/decoding scheme. Even though the fact that effective lengths differ for different channels 
was already demonstrated in [6] for the example of the binary symmetric and binary erasure 
channels, this manuscript additionally proved that not only the effective weights but also the 
instanton configurations themselves were different structurally for different channels. 

We conclude by noting that the observations made in this manuscript, extending and com- 
plementing our previous works 1 11, J2J, virtually solve in a straightforward way the problem 
of the generic error-floor analysis. (No sampling in the configurational space, e.g. of the kind 
used in ||4|], was required). We intentionally choose the well known (155,64,20) code (used 
routinely for testing) to demonstrate the exciting opportunities the instanton-amoeba approach 
has to offer. Our next goal is to apply our scheme to a variety of other (e.g. longer) codes, 
decoding schemes and channels. 
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